Balance the Contribution of Out-of-sample and Resubstitution Errors in Definition 4 Conclusions
نویسندگان
چکیده
We applied the novel bootstrap 632 b rule to choose tree-based classifiers trained for modeling the risk of parasite presence in a host population of ungulates. The method is designed to control overfitting: compact classification trees (CART) are selected using a nonlinear combination of the resubstitution error and the standard bootstrap error estimate. Model selection based on the 632 b rule offers a gain over cross-validation for CART models. The tree classifier selected by the new rule for this application favourably compared with standard multivariate GLIM models.
منابع مشابه
Exact representation of the second-order moments for resubstitution and leave-one-out error estimation for linear discriminant analysis in the univariate heteroskedastic Gaussian model
This paper provides exact analytical expressions for the bias, variance, and RMS for the resubstitution and leave-one-out error estimators in the case of linear discriminant analysis (LDA) in the univariate heteroskedastic Gaussian model. Neither the variances nor the sample sizes for the two classes need be the same. The generality of heteroskedasticity (unequal variances) is a fundamental fea...
متن کاملFrequency of Errors in Clinical Laboratory Practice
Background and Objective: Laboratory errors are one of the major factors that affect the diagnosis, prognosis, treatment and monitoring in patients.The objective of study is to evaluate the frequency and type of errors in different phases of testing at the Pathology Department of the Shalamar Hospital, Lahore and to evaluate the causes of errors. Methods: This observational study was carrie...
متن کاملThe Effect of Measurement Errors on the Performance of Variable Sample Size and Sampling Interval Control Chart
The effect of measurement errors on adaptive and non-adaptive control charts has been occasionally considered by researchers throughout the years. However, that effect on the variable sample size and sampling interval (VSSI) control charts has not so far been investigated. In this paper, we evaluate the effect of measurement errors on the VSSI control charts. After a model development, the effe...
متن کاملBalance Assessment in Children with Down Syndrome Who Practice Dance
Background. It is observed that dance delivers a valuable contribution to the development of bodily motor functions. Objectives. To evaluate the static and dynamic balance in children with Down syndrome - DS enrolled in a Dance Workshop for people with disabilities. Methods. Balance tests proposed by Oliveira (2009) were used on 14 children with DS aged between 8 and 12 (mean 9.36 ± 1.2 years...
متن کاملOptimal convex error estimators for classification
A cross-validation error estimator is obtained by repeatedly leaving out some data points, deriving classifiers on the remaining points, computing errors for these classifiers on the left-out points, and then averaging these errors. The 0.632 bootstrap estimator is obtained by averaging the errors of classifiers designed from points drawn with replacement and then taking a convex combination of...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1997